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1 . A computer-implemented method for locating regions of a target image that 
match a template image with respect to color characterization, wherein the target image and 
the template image each comprise a plurality of pixels, the method comprising: 

performing a color characterization analysis of the template image; and 

searching for regions of the target image having a color characterization that 
matches, at least to a degree, the color characterization of the template image; 

wherein said searching for regions of the target image comprises performing a color 
characterization analysis for a pliitality of regions within the target image; 

wherein the color characterization analysis performed for the template image and 
the color characterization analyses\)erformed for each of the plurality of regions of the 
target image comprise: 

examining color inforn$ttion\)f at least a subset of pixels; 
assigning each exami^pj^pi^pl to a color category that corresponds to a 
portion of a color space; 

indicative of the allocation of the examined pixels 



r 



determining informatit 
across color categories; 

wherein, for each of the plurality ofVegions of the target image, said searching 
comprises comparing the information obtained Vn the color characterization analysis of the 
region to the information obtained in the coloAcharacterization analysis of the template 
image in order to determine whether the region haA a color characterization that matches, at 
least to a degree, the color characterization of the ten^plate image. 

2 . The method of claim 1 , 

wherein said searching for regions of the target hAage comprises: 
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performing a color characterization analysis for a plurality of regions within 
the target image to generate color characterization information for each of the target image 
regions; and \ 

comparing the color characterization information of the template image with 
the color characterization information for each of the target image regions; 

determining zero or more target image regions having a color 
characterization that matches, at least to a degree, the color characterization of the template 
image. 



10 3 . The method of claim 2, 

wherein the color characterization analysis performed for the template image and 
the color characterization analys^ performed for each of the plurality of regions of the 
target image comprise: 

examining color info^atip^of at least a subset of pixels; 
15 assigning each examined pbijpHo a color category that corresponds to a 

portion of a color space; 

determining informa ion\ndicdtive of the allocation of the examined pixels 
across color categories; 

wherein, for each of the phtyality bf regions of the target image, the information 
20 obtained in the color characterization analysis of the region is compared to the information 
obtained in the color characterization analysi\ of the template image in order to determine 
whether the region has a color characterizatioi^that matches, at least to a degree, the color 
characterization of the template image. 

25 ^ 2^ The method of claim 1 , further comprising: 

generating information specifying a location Vor each region of the target image that 
is determined to have a color characterization matching the color characterization of the 
template image. 
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The method of claim 1, further comprising: 
for each region S{ the target image that is determined to have a color 
characterization matching tBe color characterization of the template image, displaying 
information on a graphical use\interface indicating a location of the region within the target 
image. 
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The method of claim 3, further comprising: 
for each region of the target image that is determined to have a color 
characterization matching the colon characterization of the template image, displaying 
information on a graphical user interface indicating a degree to which color information of 
the region matches color information onthe template image. 



The method of claim 1, 
receiving the target image; 



ler ccjmpnsing: 



wherein the target image is recer pd from one of the group consisting of: 
a memory medium, a hanjwars device, and a software application. 



The method of claim 1 , 

wherein the template image and the t^fget image comprise hue, saturation, and 
intensity (HSI) color information; 

wherein said examining color informatioiAof at least a subset of pixels comprises 
examining HSI information of the at least a subset cm pixels; 

wherein said assigning each examined pixel h a color category that corresponds to a 
portion of a color space comprises assigning each examined pixel to a color category that 
corresponds to a portion of HSI color space. 



The method of claim 1, further comprising: 
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receiving user inpuu specifying a desired color sensitivity level to use in locating 
target image regions that march the template image; 

wherein the user input\determines a number of categories into which the color space 
is divided. 

i 6, y 

8. The method of claim 1 , 

wherein said comparing information obtained in the color characterization analysis 
of each region of the target image to information obtained in the color characterization 
analysis of the template image comprises: 

for each color category of the color space, comparing the percentage of 
template image pixels assigned to me color category to the percentage of target image 
region pixels assigned to the color category. 



v 



The method of claim 1 , 



wherein the color characterizati 
comprises: 

determining one or m< 



\analysis performed for the template image further 



Ire dominant color categories, wherein the one or 
more dominant color categories are assigneu a relatively larger proportion of examined 
pixels, with respect to other color categories o^the color space. 

' The method of claim 9, 

wherein said comparing information obtained in the color characterization analysis 
of each region of the target image to informatio^ obtained in the color characterization 
analysis of the template image comprises: 

for each dominant color category, iomparing the percentage of template 
image pixels assigned to the dominant color category to the percentage of target image 
region pixels assigned to that color category. 
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The methodtof claim L 
wherein the color characterization analysis performed for each of the plurality of 
regions of the target image tutther comprises: 

performing a smoothing operation after said assigning each examined pixel 
to a color category; 

wherein the smoothing operation comprises: 

for each respective color category of at least a subset of the possible color 
categories, re-distributing a portion of the pixels assigned to the respective color category to 
one or more neighboring color categories. 



yi. The method of claim 1 ] 
wherein said assigning each e^ 
accordance with a fuzzy membership 



sd pixel to a color category is performed in 



ion. 



The method of claim 6, 



wherein said assigning each examined pixel to a color category that corresponds to a 
portion of HSI color space further comprises: 

determining if the respective pkel can be categorized as either black, gray, 
or white based on one or more of saturation and Intensity values of the respective pixel; 

assigning the respective pixel to\ a black, gray, or white category if the 
respective pixel can be categorized as black, gray, &r white, respectively; 

determining a color category for flhe respective pixel based on hue and 
saturation values of the respective pixel if the respective pixel cannot be categorized as 
either black, gray, or white. 

Jft. The method of claim 1 , further comprising: 

receiving user input specifying search criteria to \sc in locating target image regions 
that match the template image; 
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wherein the user input\determines one or more parameters affecting said searching 
for regions of the target image. 

L5. The method of claim 1 , 
wherein said searching fon regions of the target image is performed using multiple 
search passes according to a coarse\to-fine search heuristic. 



The method of claim 
wherein said searching for regions of the target image comprises: 
10 performing a first-pass ^earch through the target image to find initial match 

candidate areas; 

performing one or more subsequent search passes in which proximal regions 
of the candidate areas are searched in orde\tofind a best-matching region in the vicinity. 

15 1/7. The method of claim 1 , tu^h^r Comprising: 

determining a step size; 
wherein said searching for region^ of the target image having a color 
characterization that matches, at least to a degrqe, the color characterization of the template 
image comprises determining locations for the plurality of regions within the target image 
2 o for which the color characterization analysis is performed; 

wherein the step size is used in said determining locations for the plurality of 
regions within the target image. 

V8. The method of claim 17, 
25 wherein, after determining a first region identified by a window into the target 

image, the step size is used to slide the window along tl^e target image by a fixed number of 
pixels in order to determine a second region. 
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W. The method of claim 1, further comprising: 
determining a sub-sambling size; 

wherein the sub-sampling size is used to determine the size of the at least a subset of 
pixels examined for each of the plurality of regions of the target image. 
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20. A computer-implemented method for locating regions of a target image that 
match a template image with respect to color characterization, wherein the target image and 
the template image each comprise color information, the method comprising: 

performing a first-pass searcl\ through the target image in order to find initial color 
match candidate areas; 

for each candidate area found iA the first-pass search, searching regions proximal to 
the area in order to find a best-matching legion in the area. 



0 



regions 



arch through the target image comprises: 
at which to sample the color information 



The method of claim 20, 
wherein said performing the first 
determining a plurality 
of the target image; 

for each of the plurality of 
difference between the color information of 
template image; 

for each of the plurality of samplfe regions, designating the region as an 
initial color match candidate area if the measure of difference between the color information 
of the region and the color information of the temp\ate image is smaller than a threshold 
value. 



pie regions, determining a measure of 
region and the color information of the 



The method of claim 21, further comprising: 
performing a color characterization analysis of the template image; 
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for each of the plurality of sample regions, performing a color characterization 
analysis of the sample regionA 

wherein said determining the measure of difference between the color information 
of each sample region and me color information of the template image comprises 
5 comparing information obtained\in the color characterization analysis of the sample region 
with information obtained in the color characterization analysis of the template image. 

The method of claim\22, 
wherein the template image amd the target image each comprise a plurality of pixels; 
10 wherein the color characterization analysis performed for the template image and 

the color characterization analyses performed for each of the plurality of sample regions 
comprise: \ 

examining color information of at least a subset of pixels; 
assigning each examined ffixel to a color category that corresponds to a 
15 portion of a color space; X \ ^ 

determining information inpiaftve of the allocation of the examined pixels 
across color categories; / \ 

wherein said comparing information obtained in the color characterization analysis 
of the sample region with information obtained Yn the color characterization analysis of the 
20 template image comprises comparing the allocations of the examined pixels across color 
categories for the sample region and the template image, respectively. 

The method of claim 23 , \ 
wherein the color characterization analysis performed for the template image further 
25 comprises: \ 

determining one or more dominant color categories, wherein the one or 
more dominant color categories are assigned a relatively larger proportion of examined 
pixels, with respect to other color categories of the color space; 
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wherein said comparing information obtained in the color characterization analysis 
of the sample region with information obtained in the color characterization analysis of the 
template image comprises cobiparing the dominant color categories of the sample region 
and the template image, respectively. 

?5 . The method of ctyim 23 , 

wherein the color characterization analysis performed for the template image 
comprises examining color informition of each pixel in the template image; 

wherein the color characterisation analyses performed for each of the plurality of 
10 sample regions comprise examining \;olor information of only a subset of the pixels in the 
sample region. 

-^6. The method of claim : 

wherein the color information oft the template image and the color information of 
1 5 the target image comprise hue, saturation, and intensity (HSI) color information; 

wherein said examining color infomiation of at least a subset of pixels comprises 
examining HSI information of the at least a subset of pixels; 

wherein said assigning each examined pixel to a color category that corresponds to a 
portion of a color space comprises assigning ^pach examined pixel to a color category that 
2 0 corresponds to a portion of HSI color space. 

Vf. The method of claim 21, wherein the target image comprises a plurality of 
pixels, the method further comprising: 

determining a first step size to use in saiM determining the plurality of regions at 
2 5 which to sample the color information of the target image; 

wherein said determining the plurality of regions comprises: 
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determining a first region of the target image at which to sample the color 
information of the target imagb, wherein the first region is specified by a window into the 
target image at a first location; 

determining a sedpnd region of the target image at which to sample the color 
5 information of the target image, wherein the second region is specified by a window into 
the target image at a second location which is offset from the first location by a number of 
pixels specified by the first step size\ 

The method of claim 2V, 
10 wherein said searching regions proximal to the area in order to find a best-matching 

region in the area comprises: 

determining a second stepWze which is smaller then the first step size; 
using the second step size t^ d^rmine the regions proximal to the area. 

29. The method of claim 28, 

wherein the second step size is d&ende^t on one or more of: 
the first step size; 

the size of the initial colfor matcft candidate area. 

2K 

Jf6. The method of claim 20, 

wherein said searching regions proximal l!|p the candidate area in order to find a best- 
matching region in the area comprises: 

determining a plurality of regions proximal to the candidate area at which to 
sample the color information of the target image; 
25 for each of the plurality of proximal Sample regions, determining a measure 

of difference between the color information of the region and the color information of the 
template image; 



15 



20 
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wherein the best-matcjiing region in the area is a region with a smallest measure of 
difference. 

$s \ 

2f\ . The method of claim 20, further comprising: 

for each best-matching region found, determining a measure of difference between 
the color information of the region and the color information of the template image; 

generating a final set of regions considered to match the template image with respect 
to color characterization; 

wherein the measure of difference between the color information of each region in 
the final set and the color information of the template image is less than a threshold value. 

j4 \ 

pf£ A computer-implemented method for characterizing color information of an 
image, wherein the image comprises a plurality of pixels, the method comprising: 

for each respective pixel of at least a subset of the pixels, determining a color 
category for the respective pixel based on\hue, saturation, and intensity values of the 
respective pixel, wherein said determining dej^qciines a color category from a plurality of 
possible color categories; 

storing information regarding the pqpe^tage of pixels in each of said plurality of 
possible color categories; 

storing information regarding one or mor$ dominant color categories, wherein the 
one or more dominant color categories are assigned a relatively larger proportion of pixels 
with respect to other color categories; 

wherein the stored information characterizes d|plor information of the image. 

i5. A system for locating regions of a target image that match a template image 
with respect to color characterization, wherein the target\image and the template image each 
comprise color information, the system comprising: 

a processor; 
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a memory medium jpoupled to the processor which stores the target image and a 
color match location progra 

wherein the processor \s operable to execute the color match location program to: 

perform a first^pass search through the target image in order to find initial 
5 color match candidate areas; 

for each candidate area found in the first-pass search, search regions 
proximal to the area in order to flipd a best-matching region in the area. 

The system of claiik 33, 
l o wherein said performing thel first-pass search through the target image comprises: 

determining a plurali\y of regions at which to sample the color information 
of the target image; 

for each of the plurality of sample regions, determining a measure of 
difference between the color information of the region and the color information of the 
1 5 template image; 

for each of the pluralitV\of feample regions, designating the region as an 
initial color match candidate area if the measure of difference between the color information 
of the region and the color information olf the template image is smaller than a threshold 
value. 

Jo. The system of claim 34, whdrein the target image comprises a plurality of 
pixels, wherein the processor is further opprable to execute the color match location 
program to: 

determine a first step size to use in saidVietermining the plurality of regions at which 
25 to sample the color information of the target imige; 

wherein said determining the plurality onregions comprises: 



20 
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determining k first region of the target image at which to sample the color 
information of the target inwe, wherein the first region is specified by a window into the 
target image at a first location! 

determining a second region of the target image at which to sample the color 
information of the target imagi, wherein the second region is specified by a window into 
the target image at a second location which is offset from the first location by a number of 
pixels specified by the first step size. 

^6. The system of claini33, 
wherein said searching regions proximal to the candidate area in order to find a best- 
matching region in the area comprised: 

determining a plurality\of regions proximal to the candidate area at which to 
sample the color information of the target ilpage; 

for each of the pliiralitjpHrfwoximal sample regions, determining a measure 
of difference between the color infon$ia^on\ of the region and the color information of the 
template image; 

wherein the best-matching region i\ the area is a region with a smallest measure of 
difference. 



20 
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3 V \ 

yl. A method for locating regions of a target image that match a template image 
with respect to color characterization, the methoM comprising: 

automatically determining color features ©f the template image; 

locating one or more regions of the target piage that match the color features of the 
template image. 
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M. The method of claim 37, wherein said automatically determining color 
features of the template imagp comprises performing a color characterization analysis of the 
template image. 



^4. The method of ilaim 38, wherein said locating one or more regions of the 
target image that match the colorvfeatures of the template image comprises: 

searching for regions of the target image having a color characterization that 
matches, at least to a degree, the color characterization of the template image; 

wherein said searching for regions of the target image comprises performing 
a color characterization analysis for a plurality of regions within the target image; 



v 



The method of claim 3 
wherein the color characterize 
the color characterization analyses y 
target image comprise: 

examining color infoAiatibn of at least a subset of pixels; 



alysis performed for the template image and 
ed for each of the plurality of regions of the 



25 



assigning each examined pixel to a color category that corresponds to a 
portion of a color space; 

determining information indicative of the allocation of the examined pixels 
across color categories; 

wherein, for each of the plurality of\regions of the target image, said searching 
comprises comparing the information obtained in the color characterization analysis of the 
region to the information obtained in the coldr characterization analysis of the template 
image in order to determine whether the region has a color characterization that matches, at 
least to a degree, the color characterization of the xemplate image. 
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4K. A method forvcharacterizing the color information of an image, the method 
comprising: 

dividing a color space into a plurality of bins; 
for each of at least a subse\of pixels of the image: 
assigning the pixel t<Wbin; 

applying a fuzzy memrabe*ship function based on the location of the pixel 
within the bin to determine a contribution of the pixel to one or more neighboring bins; 

distributing the wei^ght &f the pixel across the bin and the one or more 
neighboring bins, in accordance with the contributions determined by the fuzzy membership 
function; 

wherein the distribution of pixels across the bins of the color space characterizes the 
color information of the image. 
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